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Abstract 

In this paper we settle a weak version of a conjecture (i.e. Conjecture 6) 
by Mills, Robbins and Rumsey in the paper "Self-complementary totally sym- 
metric plane partitions" J. Combin. Theory Ser. A 42, 277-292. In other 
words we show that the number of shifted plane partitions invariant under 
the involution 7 is equal to the number of alternating sign matrices invariant 
under the vertical flip. We also give a determinant expression of the general 
conjecture (Conjecture 6), but this determinant is still hard to evaluate. In 
this paper we introduce two new classes of domino plane partitions, one has 
the same cardinality as the set of half-turn symmetric alternating sign matri- 
ces and the other has the same cardinality as the set of vertically symmetric 



alternating sign matrices. 
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1 Introduction 

A totally symmetric self- complementary plane partition is, by definition, a plane 
partition which is invariant under permutation of the three axes and which is equal 
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to its complement (cf. El 113 HH 1221 122] )• The number of totally symmetric 
self-complementary plane partitions is known to be the same as that for alternating 
sign matrices and descending plane partitions. But, there are still several interesting 
conjectures concerning totally symmetric self-complementary plane partitions (see 
[T7]). This paper is the succession of my previous paper jS] in which we obtain 
Pfaffian formulae and constant term identities for Conjecture 2, Conjecture 3 and 
Conjecture 7 as an application of the minor summation formulas of Pfaffians ob- 
tained in 121 E]. In this paper we are mainly concerned with two other conjectures, 
i.e. Conjecture 4 and Conjecture 6, by Mills, Robbins and Rumsey in the paper 
[T7] . We will obtain a determinantal formula for Conjecture 6 as an application 
of essentially a Binet-Cauchy type formula. We also introduce two new classes of 
domino plane partitions which seemingly look closely related to Conjecture 4 and 
Conjecture 6. 

In Mills, Robbins and Rumsey have introduced a set of triangular shifted 
plane partitions, which is bijective to the set of totally symmetric self-complementary 
plane partitions. In this paper we denote this set by =^^„, which is defined to be the 
set of triangular shifted plane partitions b = (6ij)i<j<j<n-i whose parts are < n, 
weakly decreasing along rows and columns, and all parts in row i are > n — i. For 
b = (%)i<i<i<n-i in and k > 1, let 

n—k n—1 

Uk{b) = - bt,t+k) + Yl X{bt,n-i >n-t}. (1.1) 

t=l t=n-k+l 

Here we use the convention that = n — i for all i and 6oj = n for all j. They have 
also introduced two involutions p and 7 of i3Sn onto itself, and conjectured that they 
correspond to the half turn and the vertical flip of the alternating sign matrices. 
These involutions are defined as follows. Let b = {bij)i<i<j<n-i be an element of ^„ 
and let bij be a part of b off the main diagonal. Then the Hip of the part bij is the 
operation of replacing bij by b'^j where 

b'ij + bij = min(6j_ij, kj-i) + max(6ij+i, k+ij). (1.2) 

When the part is in the main diagonal, the flip of a part bu is the operation replacing 
bii by b[^ where 

b'ii + hi = bi_i^i + bi^i+i. (1.3) 

An operation vr^ is defined to be a map ^ where iirib) is the result of flipping 
all the bi^i+r-i, 1 < i < n — r. We can introduce two involutions p and 7 as follows: 

p = 7r27r47r6 ■ ■ ■ (1.4) 

7 = TTiTrgTTs ■ ■ ■ (1.5) 

(see {^7\ pp. 284, 286])). Mills, Robbins and Rumsey conjectured that the invariants 
of p in correspond to the half-turn symmetric alternating sign matrices, and 
the invariants of 7 in correspond to the vertically symmetric alternating sign 
matrices. Let (resp. ^^) denotes the set of elements in ^„ invariant under p 
(resp. 7). These conjectures are stated as follows. Here, for the definition of the 
numbers ^4^'^^, ^4^^,^^ and the polynomials A^'^^it), A2^^i{t), see the next section. 
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Conjecture 1.1. (^3 pp.285, Conjecture 4]) Let n > 2 and r, < r < n, be 
integers. Then the number of elements of ^„ with p{h) = b and Ui{b) = r would be 
the same as the number of n x n alternating sign matrices invariant under the half 
turn and satisfying ai r+i = 1- Namely, Efe^^i^^^'^^^ = ^n^^i^) would hold. 

Conjecture 1.2. (jTTl pp.286. Conjecture 6]) Let n > 1 be an integer and r, 
1 < r < 2r2 — 1, be an integer. Then the number of elements of ^2n+i with 7(6) = b 
and U2{b) = r — 1 would be the same as the number of n x alternating sign matrices 
with an = 1 and invariant under the vertical flip. Namely, Xlbg^^ t^'^i^) = A2n+i{t) 
would hold. 

In jHI we have introduced a set of column strict plane partitions which is 
bijective with the set of triangular symmetric plane partitions f Theorem 13. 3p . 
Namely is, by definition, the set of column-strict plane partitions in which each 
entry in the jth column does not exceed n — j. We recall these plane partitions, the 
bijections and the statistics in Section 01 In Section |3J we translate the involution Hr 
in the words of and find that the involution vr^ correspond to a Bender-Knuth 
type involution tt^ which swaps i and z — 1 in a column-strict plane partition in 
Let 

P = 7f27r47r6 ■ ■ ■ , (1.6) 
7 = TTlTTsTTs " " " , (1-7) 

and let (resp. denotes the set of invariants of p (resp. 7). Since this 

Bender-Knuth type involution tt^ is, in a sense, "twisted" (a little different from 
the ordinary one), we will see that the set <^3^,^ is naturally bijective to a set of 
"twisted" domino plane partitions in Section El (see Theorem 15. 2p . In Section we 
introduce two new classes of domino plane partitions, i.e. and Namely, 
(resp. is defined to be the set of column-strict domino plane partitions whose 
entries in the j'th column are < \{n — j)/2] and with all rows_(resp. columns) of 
even length. We also construct a natural bijection between ^2n+i S'^n-i (^^e 
Theorem 16. 2|) . It seems that ^„ and {n > 1) have the same number of elements 
from examples, but we don't know how to construct a bijection between them at 
this point (see Conjecture 16. 3p . The following diagram of the bijections give a one- 
to-one correspondence between the set ^2n+i of triangular shifted plane partitions 
invariant under 7 and the set of domino plane partitions: 

^ y2n+l T2n + 1 ^ , 

=^271+1 ^2n+l ■^2n-l =^2n-l 

Meanwhile, we obtain the following one-to-one correspondence 

^J2P ^ t2^P . ^aC * 

between the set SS'^ of triangular shifted plane partitions invariant under p and the 
set of "twisted" domino plane partitions, whereas we don't know the missing 
bijection between and In Section [71 we use a plane partition analogue $ 
of the Stanton- White bijection which maps a domino plane partition to a paired 
plane partition (see 0123), that enable us to define a bijection between (resp. 
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of domino plane partitions and (resp. of paired plane partitions, (see 
Theorem 17. 2j) . Using the generating functions obtained in jH], we obtain determi- 
nantal formulae for the generating functions of these sets of paired plane partitions 
(see Corollary 17. 7|) . As a special case we show that Conjecture 11.21 reduce to the 
evaluation of the determinant in the following theorem: 

Theorem 1.3. Let n > 2 be a positive integer. Let det R°{t) = {R°j)o<i,j<n be the 
n X n matrix where 

with the convention that Rqq = Rqi = 1. Then we obtain 

J2 =detK,(t). (1.8) 

(See Corollary IIHfii)). 

Thus Conjecture 11.21 reduce to prove that detD„(t) = A^^^-^{t) would hold. We 
also obtain a similar formula for the generating function of (see Corollarv l7.8p . 
This determinant is also conjectured to be A^'^^{t), but still hard to evaluate (see 
Conjecture I7.9p . (About determinant evaluation the reader can consult ^21)- Mean- 
while, when t = 1, we will find that we can reduce the evaluation of these deter- 
minants to the Andrews-Burge determinant (|7.2H) (see 0121111^1) and we obtain 
the result that the number of elements in (resp. is equal to the number 

A^^ (resp. A^"^^) of vertically (resp. half-turn) symmetric alternating sign matri- 
ces. Thus we prove Conjecture 11.21 is true when t = 1, whereas we can't say it for 
Conjecture II. II because of the missing bijection. Anyway we define a new object 
of domino plane partitions which has the same cardinality with the set of half-turn 
symmetric alternating sign matrices. In the study of these several classes of plane 
partitions, we will see they possess many similarities with Young tableaux and Schur 
functions, but sometimes they are twisted and have mysterious coincidences which 
we can't explain. 



2 Preliminaries 

Let An{t) be the polynomial defined by 



r=l 



where An is the number defined by An = YYi=o %+ly. ■ well-known that An is 
the number of alternating sign matrices and An{t) is the refined ASM distribution 
(see oca 122 EH). Let A^^^ be the number defined by 

^HTS _ TT (30!(3i + 2)! ^ts _ ^K3n)! hts 

to 1(^ + 0!} {(2ri)!} 
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which is known to be the number of half-turn symmetric alternating sign matrices 
(see [Ill[iniinil2ni)- The first few terms of (Q are 1, 2, 3, 10, 25, 140, 588. We 
follow [21] and define the polynomial A^'^^it) by 

^2n^it) _ (3« - 2)(2n - 1)! ^ {n{n - 1) - nr + r'^}{n + r - 2)!(2ra - r - 2)! ^ 
~ {n-l)\{3n-l)\ ^ r\{n-r)\ ^ 

(2.3) 

where I-s = nrr;|S|S|. Let 

A^it) = A^m^it), (2.4) 

and 

A^^Ut) = I {An-,im^rit) + A^m^^Ut)} , (2.5) 

which is known to be the refined enumeration of half-turn symmetric alternating sign 
matrices weighted by the distribution of one in the top row. The first few terms of 
(jH and (ESI) are Af^^{t) = 1 + t, Af^^{t) = 1 + t + Af^^t) = 2 + 3t + 3t^ + 2t^, 
Af^^{t) = 3 + Qt + 7t^ + Qt^ + 3t\ 

We follow [20] and define A^^+i and ^2n+i(t) as follows. Let A^^+i be the number 
given by 

,vs _ , o^n^ n 3(j-z) + l _ 1 A (6A:-2)!(2A:-1)! 
^2n+i-l 3J 11 _^-_, + 2n + l"2"ii(4A;-2)!(4A;-l)!- ^^'^^ 

This number A^^+i is equal to the number of vertically symmetric alternating sign 
matrices of size 2n + 1 (see [IH [131201), and the first few terms of (|2.6|) are 1, 3, 26, 
646 and 45885. Let Ay„^+i(t) be the polynomial 



1 vs _ A^t, ^ ^ ,,^, (2n + A:-2)!(4n-fc-l) 
WiW-(4^_2)!^ ' {k-l)\{2n-k)\ 



which is known to be the refined enumeration of vertically symmetric alternating 
sign matrices weighted by the distribution of one in the first column (see [20]). For 
instance, the first few terms of ^Ji) are A^^{t) = 1, A^^{t) = 1 + 1 + 1'^, A^^{t) = 
3 + 6t + 8t2 + 6^3 + 3t^ and A^^{t) = 26 + 78t + 138^^ + 162^^ + I38t^ + 78^^ + 26^^ 
and we have A^^^^{1) = A^^^^. 

Next we recall the terminology of partitions and plane partitions. We follow 
the notation in Macdonald ^H] and Stanley [21]. If the reader is familiar with the 
notion, he can skip the rest of the section. Let P denote the set of positive integers. 
A partition is a sequence A = (Ai, A2, . . . ) of non-negative integers in non- increasing 
order: Ai > A2 > . . . and containing only finitely many non- zero terms. The non- 
zero Ai are call the parts of A. The number of parts is the length of A, denoted by 
£(A); and the sum of parts is the weight of A, denoted by |A|. The diagram of a 
partition A may be formally defined as the set of lattice points G such that 
1 < j < Aj. We identify A with its diagram. The conjugate of a partition A is the 
partition A' whose diagram is the transpose of the diagram of A. A partition with 
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distinct parts is called a strict partition. The shifted diagram of a strict partition /i 
is the set of lattice points G such that i < j < fii + i. We identify a strict 
partition with its shifted diagram. 

A plane partition is an array vr = i'n'ij)ij>i of nonnegative integers such that vr 
has finite support (i.e. finitely many nonzero entries) and is weakly decreasing in 
rows and columns. If XlijM^u ~ then we write |-7r| = n and say that vr is a 
plane partition of n, or tt has weight n. A part of a plane partition vr = {TTij)ij>i 
is a positive entry TTjj > 0. The shape of vr is the ordinary partition A for which vr 
has Aj nonzero parts in the ith row. We denote the shape of vr by sh(vr). We also 
say that vr has r rows if r = ^(A). Similarly, vr has s columns if s = -^(A'). A plane 
partition is said to be column-strict if it is strictly decreasing in columns. 

Let /i be a strict partition. A shifted plane partition r of shifted shape fi is an 
arbitrary filling of the cells of fi with nonnegative integers such that each entry is 
weakly decreasing in rows and columns. In this paper we allow parts to be zero for 
shifted plane partitions of a fixed shifted shape fi. 

3 Bijections and Statistics 

First we recall the results we obtained in the preceding paper (Hj. We defined the 
set ^n,m of plane partitions and studied it intensively. This set ^n,m is also the 
main object we study in this paper: 

Definition 3.1. Let m and n > 1 be nonnegative integers. Let ^n,m denote the 
set of column-strict plane partitions c = (cij)i<ij subject to the constraints that 

(CI) c has at most n columns; 

(C2) each part in the jth column of c does not exceed n + m, — j . 

An element of J^n,m is called a restricted column-strict plane partition. When m = 0, 
we write for <^n,o- If a part in the jth column of c is equal to n + m — j, we call 
the part a saturated part. 

Let c = {cij)i<i<n+m,i<j<n be a plane partition in l!^n,m and let k he a positive 
integer. Let c>k denote the plane partition formed by the parts > k. Let 



denote the length of the ith row of c>k, i.e. the rightmost column containing a letter 
> in the ith row of c. 

Let r be an integer such that 1 < r < n + m. For c G ^^n,m let Ur{c) be the 
number of parts equal to r plus the number of saturated parts less than r, i.e. 



Especially Ui{c) is the number of I's in c and Un+m{c) is the number of saturated 



Oi{c>k) = tl{^ : Ci^i > k} 



(3.1) 



Uric) = tl{(i, j) : Cij = r} + < k < r : Ci^n+m-k = k}. 



(3.2) 
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parts in c. For example, let 
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5 
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1 
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2 


1 








1 


1 













be an element c of then, the bold faced entries are the saturated parts. Thus we 
have f7i(c) = 6, U2{c) = 1/4(0) = 1/5(0) = ^7(0) = 178(c) = 4 and 1/3(0) = f76(c) = 
5. 

We also defined the following set l3Sn,m oi shifted plane partitions in [S] , which is 
a generalization of defined in |T7t pp.281]. 

Definition 3.2. (See Theorem 1]). Let m and n > 1 be nonnegative integers. 
Let ^n,m denote the set of shifted plane partitions b = {bij)i<i<j subject to the 
constraints that 

(Bl) the shifted shape of 6 is (n + m — 1, + m — 2, . . . , 2, 1); 
(B2) max{n — i,0} < bij < n for l<i<j<n + m — 1. 

When m = 0, we write ^„ for ^n,o- In this paper we call an element of ^n,m a 
triangular shifted plane partition (abbreviated to TSPP). 

We use the convention that bi^n+m = n — i for all i and 6o,j = ^ for all j. For a 
^ = ipij)i<i<j<n+m-i in ^n,m. and an integer r such that 1 < r < n + m, let 

n+m~r n+m~l 

Ur{b) = ^ ih^t+r-l - bt,t+r) + ^ x{h,n+rn~l > U - t} . (3.3) 
i=l t=n+m—r+l 

We put Ur{b) = n + m — 1 — Urip). For example, let 

8 8 8 8 8 8 8 
8 8 8 8 7 6 
8 8 7 7 6 
6 5 5 4 
4 4 3 
3 3 
1 

be an element 6 of =^8, then we have Uiib) = 1, U2{b) = U^ib) = U^{b) = Ujib) = 
Usib) = 3 and Usib) = Ueib) = 2. 

In [H] we have established a bijection between £^n,m and ^n,m, and proved that 
these statistics agree. 

Theorem 3.3. Let m and > 1 be nonnegative integers and let c = (cjj)i<j<„+m,i<j<' 
be a RCSPP in ^n,m- Associate to the array c = {cij)i<i<n+m,i<j<n the array 
b = {bij)i<i<j<n+m-i defined by 

n - bij = 6n+m-j{c>i-i+j) (3.4) 
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with 1 < i < j < n + m — 1. Then b is in J^n,m, and this mapping (pn,m, which 
associate to a RCSPP c the TSPP b = fn.m{c), is a bijection of l!^n,m onto ^n,m- 
Further, by this bijection, we have Ur{^n,m{c)) = Ur{c) for any c G ^n,m- 

For instance, the b and c in the above examples correspond to each other by 
this bijection between and ^g. In jHl Section 2] we defined a set ^n,m of 
totally symmetric plane partitions and constructed the bijections ^n,m ^ ^n.m and 
'%i,m ^ ^n,m- Thus the study of totally symmetric plane partitions reduce to the 
study of restricted column-strict plane partitions. 

4 A twisted Bender-Knuth involution 

A classical method to prove that a Schur function is symmetric is to define involu- 
tions Si on tableaux which swaps the number of z's and {i — l)'s, for each i. This is 
well-known as the Bender-Knuth involution (|3]). In this section we define a twisted 
Bender-Knuth involution tt^. of the set <^^n,m of RCSPPs and show that it correspond 
to the involution vr,. of ^n,m- We continue to use the convention that bi^n+m = n — i 
for all i and boj = n for all j . 

In Mills, Robbins and Rumsey have introduced the notion of flip for J3§n- 
We can naturally generalize this notion to ^n,m by the same equations p.2|) and 
fjl.3|) . whereas we have to be careful about the range of m. Let m and n > 1 
be non-negative integers. Let b = (6jj)i<j<j<„+m_i be an element of ^n,m and let 
1<'^<J <n + m — Iso that bij is a part of b off the main diagonal. We define 
the Bip of the part b^j as the operation of replacing bij with b[j with (|1.2p . Note 
that this operation is always well-defined since b'^j satisfies the axiom (B2), and the 
result of flipping bij is a shifted plane partition. In fact b G ^n.m implies that 
min(6j_ij, 6j > bij > max(6j j+i, j) so that we have n > min(6j_ij, 6j > 
b'ij > max(6jj+i, > and b'ij > > n — i. 

When the part is in the main diagonal, we define the flip of a part ba as the 
operation replacing bu with b[^ with (jl.3|) . Note that the result of flipping a part 
bii in the main diagonal may violate the axiom (B2) unless m = or m = L In 
fact, if m > 2, then can be negative since 6„+m-i,n+m = I — m < 0. 

Thus, hereafter, we assume m = or 1 when we consider a flip of a part in the main 
diagonal. 

Let 1 < r < n + m and b = (&ij)i<i<j<n+m-i G ■!3§n,m- Define an operation 
: ^n,m ^ ^n,m hj b T^rib) where TTrib) is the result of flipping all the bi^i+r-i, 
1 < i < n + m — r. Since none of these parts of b are neighbors, the result is 
independent of the order in which the flips are applied, and this operation Wr is 
evidently an involution, i.e. vr^ = id. For instance, the following TSPP b G 
is mapped to the following TSPP 7r2(6) by the involution 712, and to the following 
TSPP 7Ti{b) by the involution vti; 



b 



6 6 6 6 5 
6 5 5 5 
4 4 4 
4 4 
1 



vr2(6) 



6 5 6 6 5 
6 5 5 5 
4-^4, 



vri(6) 



5 6 6 6 5 
5 6 5 5 
5 4 4 

4 2 
4 



4 2 
1 
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Now we define a Bender-Knuth type involution vf,. : ^n,m ^n,m- This involu- 
tion TTr is an "almost Bender-Knuth involution" which swaps r's and r — I's except 
the fact that it does not count a saturated r — 1. In fact, if it did convert a saturated 
r — 1 of c in S^n^m-, the resulting plane partition could violate the axiom of S^n,m- 
Let see the exact definition. Let 2 < r < n + m and c e ^^n,m- Consider the parts of 
c equal to r or r — 1. Since c is column-strict, some columns of c will contain neither 
r nor r — 1, while some others will contain one r and one r — 1. These columns we 
ignore. We also ignore an r — 1 in column n + m — r + 1, i.e. we ignore a saturated 
part which is equal to r — 1 because a saturated r — 1 can't be changed to r. The 
remaining parts equal to r or r — 1 occur once in each column. Assume row i has a 
certain number k of r's followed by a certain number / of r — I's. Note that we don't 
count an r — 1 if it is saturated so that a saturated r — 1 always remains untouched. 
For example, the three consecutive rows i — 1, i and i + 1 of c could look as follows. 
In row i, convert the k r's and / r — I's to / r's and k r — I's. It is easy to see that 



i - 1 












r 


r 


i 


r 


r 


r 


. r r — 1 


r — 1 


r — 1 


r — 1 


i + 1 


r — 1 


r — 1 













the resulting array satisfies the axioms (CI) and (C2) of ^n,m- Define an operation 
TTr : =^^n,m — > ^n,m by c I— >• TTr{c) where TTr{c) is the result of swapping r's and r — I's 
in row i of c by this twisted rule for l<i<n + m — r. For example, if n = 6, m = 
and r = 2, then the left below RCSPP c corresponds to the right below RCSPP 
7r2(c) by TT2. 



5 


3 


1 


1 


1 


7r2(c) = 
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2 










3 


2 
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1 
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1 









Next assume m = or 1, and let c be a plane partition in l^n,m- Set Aj = 9i{c>2) 
to be the number of parts > 2 in the zth row of c. Assume the zth row contains a 
certain number A; of I's followed by a certain number I of blank positions which I's 
can be put in, so that we have k + l = n + m — 1 — \iiii = l,k + l = Aj_i — Aj 
otherwise. Change the number of I's from /c to / in row i for l<i<n + m— 1. It 
is also easy to see that the resulting array, say 7ri(c), satisfies the constraints (CI) 
and (C2). For example, if c is as above, then 7fi(c) is as follows: 



VTi C 



This mapping tti : <^^„ 



l^r> m is well-defined for m 



involution. We call this involution vr^, 1 < r < + m. 



: 0, 1, and is evidently an 
a twisted Bender-Knuth 
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involution (abbreviated to the TBK involution). Note that when r = n + m, Hn+m 
and Tin+m are both the identity mapping since there are no parts affected by the 
operations. The following proposition corresponds to Theorem 2 of ^3 pp.283], 
whereas there is no need of proof since it is clear from the above definition. 

Proposition 4.1. Let m and n > 1 be non- negative integers. Let 2 < r < n + m 

and let c in ^3^n,m- Then 

Ur (7fr-(c)) = Ur-l (c) and Ur (c) = Ur-l {jtr^c)) □ 

The following theorem tells us that the involution vr^ of ^n,m corresponds to tt^ 
of <^n.m if we identify ^n,m with I^n.m by the bijection ipn,m defined in Corollarv l3.31 

Theorem 4.2. Let m and n > 1 be non-negative integers and let 1 < r < n + m. 
Assume m = Oorlifr = l. Then we have 

TTr (</?n,m (c)) = ^n,m (7fr(c)) . 

In |17| pp.284], Mills, Robbins and Rumsey defined an involution p of ^„ by 
p = 712^4 ■ ■ ■ and presented a conjecture (Conjecture 11.111 that this involution p 
corresponds to the half turn of an alternating matrix. We naturally generalize this 
definition to J3^n,m and use the same symbol for the involution p : J3^n,m ^n,m 
defined by 

p = 7r27r4--- (4.1) 

where the product is over all Hi with i even and < n. Let ^ denote the set of 
elements of ^n,m invariant under p, i.e. ^ = {b E SSn,m \ p{b) = b}. For instance, 
the following TSPP is an element of 

8 8 8 8 7 7 7 
8 8 8 7 7 7 
7 7 7 7 7 
6 5 6 5 
6 5 4 
4 S 
1 

By Theorem 14.21 we can reduce the properties of p to those of the corresponding 
involution p : J^n,m ^n,m defined by 

P = TT2TT4--- (4.2) 

where the product is over all yfj with i even and < n. In other words, given a plane 
partition c in ^n,m, p swaps I's and 2's in c by the TBK involution, then swap 3's 
and 4's in c and so on. The resulting plane partition does not depend on the order 
of the swaps, and is an element of <^n,m- Let denote the set of elements of 

J^n,m which is invariant under p, i.e. J^lrn = {c G J^n,m \ p{c) = c}. For example. 
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if n = 8, then the following RCSPP in is invariant under p: 



Thus = {0}, = {0, [T\}, and is composed of the following 3 RCSPPs: 



^4 is composed of the following 10 elements: 







2 1 



2 1 1 



2 




2 


1 


1 




1 





2 


2 


1 


1 



2 


2 




1 


1 





3 






3 




1 


2 


1 




2 


1 




1 




1 







^5 has 25 elements, and has 140 elements. 



Also in pp.286] the involution 7 = ttittstts ■ ■ ■ on is defined and conjec- 
tured to have the same effect as the flip of an alternating matrix around the vertical 
axis (Conjecture II. 2j) . Naturally we can generalize this definition to the involution 

7 : ^n,m ^n,m, m = 0, 1, defined by 



7 = TTiTTavrs ■ ■ ■ 



(4.3) 



where the product is over all vTj with i odd and < n. Let ^ denote the set of 



n,m 



elements of ^n,m invariant under 7. For instance, the following TSPP in 
invariant under 7: 



IS 



7 7 
6 



7 

5 
5 



7 
5 
5 
5 



7 

5 
5 

5 

4 



The corresponding involution 7 : <^3^„ , 



7 
5 

5 

4 
3 
2 

m 



0, 1, is defined by 



7 = TTiTTsTTs ■ • • 



(4.4) 



where the product is over all tTj with i odd and < n. For m = 0, 1, let l^nm denote 
the set of elements of ^„,m invariant under 7, i.e. = {c G .^3^n,m I 7(c) = c}. 

But, since ^„,i = ^„+i,o which implies = ^n+i^ o'^ly need to study 
Also note that = unless n is odd. In fact, for c G ^n,m, there are, in total. 
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exactly n — 1 positions where one can put I's. But, if c is invariant under 7, then 
those positions must be half filled. Further one can easily see that the shape of c>2 
must be even. For example, if n = 7, the following RCSPP in is invariant under 
7- 



Thus we have 



H I ) ^5 is composed of the following 3 RCSPPs: 



2 1 



3 


3 


1 


2 


2 




1 







and ^5 has 26 elements. 

By Theorem \A.'2\ we have established a bijection between i^^^ and 
a bijection between S^Zm- By this bijection the weight function Ur on 

!^n,m is exactly the same as f/^ on 3^n,m- Thus we study <^^^„i and with this 

weight V y in the rest of this paper. 

Proof of Theorem 14.21 Let c = (cjj)i<j<„+m-i,i<j<n be a plane partition in ^^n,m- 
We set h = {bij)i<i<j<n+m-i = V^n,m(c) e Mn,m to be the TSPP mapped by the 
bijection and set b' = (^■j)i<j<j<„+m-i = T^rib) G ^n,m to be the flipped result of b. 



Let c' = (d 



' l<i<n+m~l,l<j<n 



fn^mi^') ^ ^n,m bc the Corresponding RCSPP. 



First, assume 2 < r < n + m. Then b' is the resulting TSPP of flipping the part 

+r-l 

where 



bi^i+r-i, i = I, ■ ■ ■ ,n + m — r, i.e. replacing ba^r-i by fe^ j+^-i for z = 1, . . . ,n + m — r 



If we restate this operation vr^ : 6 i— 6' by the bijection rule (|3.4j) . then this corre- 
sponds to the following operation tt^ : c 1— c': 

(i) 6'j(c'>r) is given by 

6i{c'>r) + 6i{c>r) = max(6li(c>r+i), ^2(c>r-i)) + min(n + m - r, 6'i(c>r_i)) 
if i = 1, and 

Oi{c'>r) + Oi{c>r) = max{9i{c>r+i),9i+i{c>r^i)) + mm{9i_i{c>r+i),9i{c>r-i)) 
if i = 2, . . . , n + m — r. 

(ii) If 7^ r, then 9i{c' >k) = 9i{c>k) for all i. 
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This means the operation vfr changes the number of the letters r's and r — I's in each 
row i of c, and keeps other letters invariant. If one inspects these rules carefully, 
then these rules gives precisely the TBK involution. 

Next, assume r = 1 and m = 0, 1. Then b' is the resulting TSPP of replacing bu 
by for 2 = 1, ...,n + m — 1 where 

Ki + ^ii ~ + bi,i+l- 

Using the rule (j3.4j) again, the operation tt^ : b ^ b' corresponds to the operation 
TTr : c I— > c' with 9i{c' >r) given by 

^i(c'>i) +^i(c>i) = ei{c>2) + n + m - 1 

if i = 1, and 

ifz = 2, ...,'n. + m — 1. This is exactly the operation yfi : c i— > c' we defined above. 
This completes the proof. □ 



5 Twisted domino plane partitions 

In this section we consider the invariants of the involution p defined in the previous 
section, which leads us to define a notion of generalized domino plane partitions. In 
fact, here, we consider a natural bijection as follows. Assume c G ^n,m is invariant 
under p, i.e. invariant under for any i. Then we replace paired 2i and 2^ — 1 in 
a column by a domino, and replace non-paired k 2i's and k 2i — I's in a row by k 
dominoes. But there may remain some saturated parts unchanged, thus we obtain 
a "twisted" domino plane partition by this operation. In this manner we give a 
natural bijection of ^^^^ to a new object which we denote by ^^n,m- But we don't 
know how to count this set at this point. Anyway let's start with definitions. 

A domino is a special kind of skew shape consists of two squares. A 1 x 2 domino 
is called a horizontal domino while a 2 x 1 domino is called a vertical domino. Let A 
be a partition. A generalized domino plane partition of shape A consists of a tiling 
of the shape A by means of ordinary 1x1 squares and dominoes, and a filling of each 
square or domino with a positive integer so that the integers are weakly decreasing 
along either rows or columns. The integers in the squares or dominoes are called 
parts. In this paper we call a part a single part if it is in a square, i.e. not in a 
domino. Further we call it a domino plane partition if the shape A is tiled with only 
dominoes, i.e. without a single square. We say that a part is in the ith row (resp. 
jth column) if the square or domino which contains the number intersects with the 
ith row (resp. jth column) of A. A (generalized) domino plane partition is said 
to be column-strict if it is strictly decreasing along each column. For example, the 
left-below is a column-strict generalized domino plane partition of shape (4, 3, 2, 1), 
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while the right-below is a column-strict domino plane partition of shape (4,4,2). 



2 


1 


1 


1 


1 





Definition 5.1. Let m and n > 1 be nonnegative integers. Let ^n,m denote the 
set of column-strict generalized domino plane partitions c subject to the constraints 
that 

(El) c has at most n columns; 

(E2) each part in the jth column does not exceed \{n + m — j)/2\] 

(E3) If a part in the jth column is equal to \{n + m — j)/2] and n + m — j is odd, 
then it must be a single part. On the other hand, if a single part appears in 
the jth column of c, then n + m — j must be odd and it must be equal to 
\{n + m-j)/2]. 

We call an element in ^n.m a twisted domino plane partition, and we simply write 
for ?fn,o- If c is in '^^n,m, we call a single part in c a saturated part, which can 
appear only in the first row. Thus a saturated part is always a single part and vice 
versa, which equals \{n + m — j)/2'\ appearing in the cell (1, j) where n + m — j is 
odd. 



For instance, 
ments: 



{0}, ^2 = |05 13 1' composed of the following 3 ele- 





is composed of the following 10 elements: 



1 1 



2 



2 


1 


1 





2 


1 


1 


1 







^5 has 25 elements and has 140 elements. For example, if c G ^5, all parts in 
the 1st and 2nd columns are < 2, and all parts in the 3rd and 4th columns are < 1. 
A saturated (=single) part equal to 2 can appear in the cell (1,2), and a saturated 
part equal to 1 can appear in the cell (1,4). 

For c G ^„,m, let Ui{c) denote the number of I's in c. From the above examples 
we obtain that the first few terms of ^^^^^ t^^^^^ are 1, 1+t, l+t+t^, {i+t){2+t+2t^), 
Z + Qt + lt^ + + 3t^ and 5(1 +t)(l +^t^){2 + 3t + 2t^). 
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Let m and n > 1 be nonnegative integers. Let's consider the situation when we 
apply TTr to a plane partition c in S^n,m- We say an entry r or r — 1 in c is free if it 
is not saturated r — 1 nor there is no corresponding r — 1 or r in the same column. 
If r and r — 1 are in the same column, we say they are paired. Thus an r — 1 in c 
can be free, paired or saturated, whereas an r in c can be free or paired. 

Let c be a plane partition in t^^^, i.e. c is invariant under each TT2r for r > 1. 
We associate to c a column-strict generalized domino plane partition d as follows. 
For each r > 1, we replace paired 2r and 2r — 1 by a vertical domino containing r, 
and, if row i contains k free 2r's and k free 2r — I's, then we replace these with k 
horizontal dominoes containing r. Finally a saturated part equal to 2r — 1 should 
be replaced by a single part r. Let us denote by 4'n,m{c) the resulting generahzed 
domino plane partition d. We may use the abbreviated notation ipnic) for ipn,oic)- 
For example, the left-below plane partition in is mapped to the right-below 
generalized plane partition in ^fg by ipg'- 



4 



4 


2 


2 


1 


1 


3 


1 






1 








1 











Theorem 5.2. Let m and n > 1 be nonnegative integers and let c = (cij) i<i<n+m,i<j<n 
be a plane partition in S^^^. Associate to c the generalized domino plane partition 
■^n.mlc) as above. Then '^n,m{c) is in $Ci,m, and '?/'n,m is a bijection between S^nrn 
and ^„rn- 



6 Domino plane partitions 

In this section, we introduce two important classes of domino plane partitions, i.e. 
^^rn ^nm- The main result of this section is Theorem 16.21 which shows that 
there is a bijection between the set S^2n+\ restricted column-strict plane partitions 
invariant under 7 and the set of restricted domino plane partitions with all 

rows of even length. At the end of this section we state a conjecture that the set 
^n.,m of twisted domino plane partitions and the set 2^nm of restricted domino plane 
partitions with all columns of even length would have the same cardinality, and the 
statistics f/ 1 would have the same distribution. Now we start from the definition of 
these classes. 

Definition 6.1. Let m and n > 1 be nonnegative integers. Let ^ri,m denote the 
set of column-strict domino plane partitions d = {dij)i<ij subject to the constraints 
that 

(Dl) d has at most n columns; 

(D2) each part in the jth column does not exceed \{n + m — j)/2]; 
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An element of &n,m is called a restricted domino plane partition (abbreviated to 
RDPP). If a part in the jth column of c is equal to \{n + m—j)/2], we call the part 
saturated. For d G ^n,m and a positive integer r > 1, let Ur{d) denote the number 
of parts equal to r plus the number of saturated parts less than r. Further, if d in 
^n,m satisfy the condition that 

(D3) each row (resp. column) of d has even length, 

then d is called a restricted column-strict domino plane partition with all rows (resp. 
columns) of even length. The set of all d G ^n,m with all rows (resp. columns) of 
even length is denoted by (resp. ^nm)- When m = 0, we write ^„ for ^n,Q, 

for and for ^^Q.' 

For example, = = {0}, !^f' is composed of the following 3 elements: 



is composed of the following 4 elements: 



^f' has 26 elements, S'^ has 50 elements, and has 646 elements. 

Let n be a positive integer, and assume c = (cjj)i<ij<n is in ^^2n+iy i-^- ^ i^ 
invariant under each 7f2r-i for r > 1. For each 7r2r-i, we use the notation "free", 
"paired" and "saturated" for parts equal to 2r + 1 or 2r as before. We associate 
to c a column-strict (generalized) domino plane partition d as follows. First of all, 
since c is invariant under tti, which means the shape of c>2 must be even. Thus we 
remove all I's from c so that each row of the resulting plane partition c>2 has even 
length. Next, since c>2 is invariant under tt^, we replace paired 3 and 2 by a vertical 
domino containing 1, and, if row i contains k free 3's followed by k free 2's, then 
we replace them by k horizontal dominoes containing 1. If there exists a saturated 
part equal to 2, it should be replaced by a single box containing 1. Next we replace 
paired 5 and 4 by a vertical domino containing 2, and, if row i contains k free 5's 
followed by k free 4's, then we replace them with k horizontal dominoes containing 
2. If there is a saturated part equal to 4, it is replaced by a single box containing 2. 
We repeat this process and finally obtain a column-strict (generalized) domino plane 
partition d with all rows of even length. Let us denote the resulting (generalized) 
domiiio plane partition d by r2„+i(c). For example, the left-below plane partition c 
in <^^7i is mapped to the right-below generalized domino plane partition d in by 



c = 


7 


7 


6 


6 


3 


2 


1 


1 


d = 


3 


3 


1 




5 


5 


4 


3 


1 










2 


2 


1 






4 


3 


2 


2 












1 






1 


1 
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Theorem 6.2. Let n be a positive integer. Let c be a plane partition in ^2n+i- 
Then, T2n+i{c) has no saturated part, i.e. T2n+i{c) G ^fn-i- Thus T2n+i gives a 
bijection of ^2n+i ^^^^ ^2n-i- Further we have Ui{T2n+i{c)) = U2{c). 



Proof. Let c be a plane partition in ^2n+i let d = r2„+i(c). Note that a 
saturated part n + 1 — i [i = 1, . . . ,n) in d can appear in the cell (1, 2z — 1) if there 
exists. Let A be the shape of c>2. As a tableau can be expressed by a sequence of 
partitions (see [13 P-5]), we can write the generalized domino plane partition d by 
a sequence 

= A(°) c A(^) c . . . c A(") = A 

of partitions in which A^*^ / A^*"^-* consists of all the cells and dominoes that contain 
the letter n + 1 — i. If necessary, we add a zero at the end of A and we write A = 
(Ai, A2, . . . , A2r) as a sequence of even length. Then we can write A^*-* = (A^^*'', . . . , X2}) 
with A^*'' > ■ ■ ■ > Agr > for i = 1, . . . ,n. For example, the above domino tableau 
d in % is expressed by the sequence: A(°) = (0,0,0,0), A^^) = (4,0,0,0), A^^) = 

= aJ'^ + 2r - j for i = l,...,n 

1, . . . , 77,. In the 
= (7,5,2,0) and 



(4,3,1,0) and A^^) = (6,4,4,0). If we put 
and j = 1, 



2r, then we have 



> 



> i'iJ > for I 



above example, we have = (3,2,1,0), = (7,2,1,0), £(2) 



£(3) = (9,6,5,0). When z = 0, we have 



9(0) 



2r — j for j 



1, . . . , 2n, and 

consist of r even integers and r odd integers. For each i = 1, . . . ,n, if there is no 
saturated part equal to n + 1 — z, then A^*-*/-^''*"^'' contains only dominoes, thus the 
cardinalities of odd integers and even integers in i^^^ are the same as those of 
Assume there was certain i such that A''*^/A^*~^-' contain a saturated part n + 1 — i 
in (1,22 — 1). Then the cardinality of odd integer would decrease by 1, and the 
cardinality of even integer would increase by 1 if we compare with Thus, 
if there were saturated parts, finally i^^^ would contain less odd integers than even 
integers. Since A is even partition, we have i^^^ + j must be even for j = 1, . . . , 2r, 
which implies we must have the same number of even integers and odd integers in 
£in)_ xhis is a contradiction. Thus we conclude that d has no saturated part and it 
is easy to see that d is in The construction of d e ^^n-i from c G ^2n+i is 

clearly reversible and give a bijection of ^2n+i onto 3>^n-\- Since 3's and 2's in c 
is replaced by dominoes containing I's, we have U^if) = Ui{d). This completes the 
proof. □ 



Next we give examples of We have = {0} 
the following 3 elements: 



, and has 



0, 



has the following 10 elements: 



2 



2 
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1 


1 


1 




2 


1 


1 



1 1 1 

1 ) I 1 ) I 1 ) 

and it is not hard to see that has 25 elements, has 140 elements, and 
has 588 elements. In this example the bold-faced parts are saturated. The author 
computed examples for small n, m and observe that the cardinalities of ^n,m and 
^nm agree for < 6. 

Conjecture 6.3. Let m and n > 1 be non-negative integers. Then there would be 
a bijection which proves that '^n,m and S^^^n has the same cardinality. Moreover this 
bijection keeps Ui (i.e. the number of Is) invariant. 



7 Determinantal formulae 

A standard map which associate a /c-tuple of tableaux with a given /c-rim hook 
tableaux is presented in the paper |2Sl Section 6] (see also 13 Theorem 6.3]). Es- 
sentially we can use this map to associate a pair of column-strict plane partitions 
in l^n,m with a domino plane partition in &n,m- By this map we can rewrite the 
statistics Uk on &n,m defined in the previous section as the sum of the statistics 
of each column-strict plane partition. Thus we can obtain the generating functions 
of Qinm and as an application of [SI Lemma 7.1] (see Theorem 17.21 Corol- 

lary [TiTj). As a corollary of these generating functions we obtain a determinantal 
formula fCorollarv 17.81^ 11)) for Conjecture 11.21 Thus Conjecture 11.21 reduce to a de- 
terminant evaluation problem f Conjecture 17.9( 1)). In the special case where t = 1, 
we prove the conjecture from Andrews-Burge determinant (see Lemma (7.101 Theo- 
rem [7^^. 

Let A be a partition. We define a pair (A^'^-', A'-^-') which is called 2-quotient of A as 
follows. If necessary, we add a zero at the end of A and we regard A = (Ai, A2, . . . , \2n) 
as a sequence of integers of even length. Let £ = \ + = (Ai -|- 2n — 1, A2 + 
2n - 2, . . . , A2n), and put i = W where = {x E i : x = (mod2)} 
and £(1) = {x e i : X = 1 (mod2)}. We can write = {2kf\ . . . ,2ki^^) and 
£(1) = (2A;f ^ + 1, . . . , 2ki^^ + 1) where fcf^ > ■ ■ ■ > ki^^ > and k'^^ > ■ ■ ■> k^^^ > 0. 
The partition A'-''-* (resp. A^^-*) is defined to be {kf^ — r + 1, ^2'^'' — r -|- 2, . . . , ki^'^) 
(resp. {k^^ — s + 1, k'^^ — s + 2, . . . , k^s'^)). For example, if A = (5, 5, 3, 1, 1, 1), then 
we have A(°) = (3, 2, 1) and A^^) = (2). 

Definition 7.1. Let m and ?i > 1 be nonnegative integers. Let denote the set 
of all pairs p = (cq, Ci) of plane partitions such that 

(i) Co e ^no,mo where no = [f ] and mo = [n+^+i] _ no, 

(ii) Ci e ^ni,mi where rii = [|J and nii = [ "+^+^ J - rii. 

For p e and a positive integer r > 1, let Ur{p) = Ur{co) + Ur{ci). Further 

let denote the set of all pairs p = (co,ci) G ^n,m such that sh(ci) C sh(co) 

and sh(co)\sh(ci) is a vertical strip. Meanwhile, let denote the set of all pairs 
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p = (co, Ci) G ^n,m such that sh(co) C sh(ci) and sh(ci)\sh(co) is a horizontal strip. 
We also write for ^^,0^ -^n ^n,o short. 

4 and m = 0, then the pairs (cq, ci) in satisfy the 
Ci G .^^2 and sh(co)\sh(ci) is a vertical strip. Thus, 



For example, if n = 
condition that Cq G ^2,1 
has the following 10 elements: 



(0, 0) , 



m,[i] 



1 





1 1 


1 




(co 


,Cl 



satisfy the condition that cq G .^^2,1, ci G .^^2 and sh(ci)\sh(co) is a horizontal strip. 
Thus, has the following 4 elements: 



(0, 0) , 



Here we describe a bijection of column-strict domino plane partitions onto pairs of 
column-strict plane partitions. Given a domino a, the upper-rightmost cell in a is 
called the head of a, and the lower-leftmost cell in a is called the tail of a. For 
any skew-shape, we number the diagonals, beginning with for the main diagonal, 
increasing up and to the right and decreasing down and to the left. The diagonal 
diag (a) of a domino a is the diagonal of the head of a, and the color Color (a) of 
a is diag (a) mod 2. In the following pictures, we draw only the diagonals whose 
numbers are even. 






Color Color Color 1 Color 1 

Assume we are given a column-strict domino plane partition d. For each k = 0, 1, 
we associate a column-strict plane partition Ck with d. Along each diagonal diag (r), 
we read only the numbers in the dominoes that cross diag (r) and has color k. We 
replace the dominoes by single cells containing the numbers and slide down along 
the diagonal diag (r). In this way we obtain an (ordinary) column-strict partition 
Ck- For example, we associate the column-strict domino plane partition 



d 




the pair 



Co = 


1 


1 


Cl = 


3 


3 


1 










2 


2 





of plane partitions. Let $ denote the map which associate the pair (cq, Ci) of column- 
strict plane partitions with a column-strict domino plane partition d {ci. fl^ Sec- 
tion 6], [3 Theorem 6.3]). 
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Theorem 7.2. The restriction of the map ^ : d ^ (cq, ci) to ^n,m gives a bijection 
of ^n,m onto ^n,m- By this bijection the (sh(co), sh(ci)) is the 2-quotient of sh.{d), 
and we have Ur{d) = Ur{^{d)) for d G ^n,m and r > 1. Especially, the restriction 
of the map $ to (resp. ^n,m) gives a bijection of &n,m (resp. onto ■^S^^^n 

(resp. •^nm) which preserve the statistics Ur- 

Proof. The first half of the theorem is an easy consequence of the definition. The 
latter half of the theorem follows from the following proposition. □ 

Proposition 7.3. Let c? be a column-strict domino plane partition, and let (cq, Ci) = 
Then 

(i) All rows of d have even length if, and only if, sh(co) C sh(ci) and sh(ci)\sh(co) 
is a horizontal strip. 

(ii) All columns of d have even length if, and only if, sh(ci) C sh(co) and sh(co) \ 
sh(ci) is a vertical strip. 

(iii) All rows and columns of d have even length if, and only if, sh(co) = sh(ci). 

Proof. Let A = sh{d) and let (A^°\ A*^^^) denote the 2-quotient of A. We regard A = 
(Ai, A2, . . . , A2„) as a sequence of integers of even length as before. Put i = X + 62n, 
and let = {x e i : x = (mod2)} and i'-^^ = {x e i : x = I (mod2)}. 

(i) Note that A is even partition if, and only if, ii = i (mod2). This implies 



em = (£2,...,£2n) = (2fci°),...,2A;f ) and = (£1, . . . , fsn-i) = (2A;f ^ + 
l,...,2fci'^ + 1) with k^^^ > > k^^^ > /tf > ■■■ > k^n^ > kT > 0. 
Thus, if we put A(°) = {\f\ Ai°^) and A^^) = {Xf\ X^n^), then we have 
a!'^ > Af^ > A^'^ > Af > ■ ■ ■ > X^n^ > Ai°' > 0. This proves that A(o) C A^^) 



and A'-^^ \ A'^^-' is a horizontal strip. The reverse can be proved similarly, 
(ii) Note that A' is even if, and only if, £21-1 = ^'21 + 1 for z = 1, . . . ,n. This implies 



£(0) = {2kf\ . . . , 2kl^^) and i^^^ = (2fcf ^ + 1, . . . , 2kl^^ + 1) with k^f^ > ■■■> 
k^n^ > 0, A;f^ > • ■ ■ > A;i^^ > and A;f ^ = or - 1 for z = 1, . . . , n. 
Thus, if we put A(°) = (AS°\...,Ai°^) and A^ = {X^^\ . . . , X^^), we have 
Af ) = Af ^ or Af - 1 which is equivalent that A^^) C A^o) and A(°) \ A^^) is a 



Lemma 7.4. Let n and be positive integers such that n < N. Let A = [aij) and 
B = (bij) he n X N matrices. 



vertical strip. 



(iii) This immediately follows from (i) and (ii). 



This completes the proof. 



□ 



(i) Let C = (cij) denote the n x N matrix whose ( 
Then we have 



z,j)th entry is a, 





detAV, 



(7.1) 
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where the sum runs over all (ji, . . . , j„) and {ki, . . . , such that 
I < h < 31 < h < J2 < ■ ■ ■ < kn < Jn < N. 
ii) Let C = (c^ ■) denote the nxN matrix whose {i, j)th entry is c- • = 



Then we have 



J]det 



\^n,ji 



det 



^bi^ki ■ ■ ■ &i,fc„^ 

\bn,ki ■ ■ ■ bn,knj 



^fe=max(l,j — 1) bik' 



detAV', (7.2) 



where the sum runs over all (ji, . . . ,jn) and {ki, . . . , kn) such that 

1 < Ji < J2 < ■ ■ ■ < Jn < iV, 

and max(jj,„i + — 1) < k^ < ju for /i = 1, 2, . . . , n. Here we use the 
convention that jo = 1- 

Proof. The both of the identities ()7.1|) . ()7.2j) reduce to the following Cauchy-Binet 
identity: Let X = (xij) and Y = (yij) he n x N matrices. Then 



^det 



A 



det 



detXY, (7.3) 



" Jn / \yn,ji ■ ■ ■ yn,j„ / 



where the sum runs over all 1 < ji < j2 < ■ ■ ■ < jn ^ N. For example, to prove 
(j7.1|) using (j7.3|) . it suffices to show that 



Jl 32 



det C'ji j2,,,,j„ 



fcl = l fc2=il + l fc7i=jn-l + l 



This can be easily seen if one writes 



J2 



fe=l fc=l fc=ji+l k=jv-i+l 

for 1 < i,!/ < n. The other identity ()7.2p can be derived similarly. 



□ 



In jH] we obtained the generating function of ^n,m weighted by the statistics U k 
and parts. Here we cite the theorem as the following lemma without proof. 

Lemma 7.5. (|H1 Lemma 7.1]) Let m and n > 1 be non-negative integers, and fix 
a positive integer N > n + m. Let A be a partition with i{X) < n. For c G ^n,m, 

let t^^^^x'' denote Y^=i^^^^''^ Y\.i>i^T^ ^ where denote the number of z's in c. We 
put Hi = tiXi and Yi = Y[k=i^k ^i, and use the vector notation y^^^ for the r-tuples 
{i/i, . . . ,yr) of the variables. Then the generating function of all plane partitions 
c G ^n,m of shape A' with the weight t^^'^^x^ is given by 



X t^^'^x<^ = det (ei';^7-;)(z/("+™-^-^ 



sh(c) = A' 



l<i j'<n 



(7.4) 
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As an application of Lemma 17^ and Lemma 1731 we obtain the following theorem, 
which give us the generating function of ^n.m ^n.m with the same weights. 

Theorem 7.6. Let m and n > 1 be nonnegative integers, and fix a positive integer 
N>n + m. Put no = [f ] , mo = - rio, ni = [f J and mi = [^^±f±ij - n,. 

For a domino plane partition d G !^n,m, let t^('^^x'^ denote Ylk=i '"^'^^ Y[i>i ^T' where 
mj denote the number of i's in d. We put yi = tiXi and Yi = IlfcLi^fc^^j, and write 
y^'^^ for the r-tuples {i/i, ... ,yr), where we use the convention that {y^^~^\Yr) is 
empty if r < 0. 

(i) If n is even (i.e. Uq = rii), then we obtain y^j^iaR t'^^^^x'^ = det i?, where 
R = {Rij)o<i<no-i,o<j<ni-i is the no x rii matrix whose (i, j)th entry is 

fc>0 

(ii) If n is odd (i.e. no = ni + 1), then we obtain '^^^o^k t'^^^^x'^ = det ( r | i? ) , 
where 

= E e^rr'^'\y^-^^^^~'\ 1) e£;+l)(^(-+^-i), (7-6) 

fc>0 

and r = (r'j)o<j<„o-i is the column vector whose ith entry is rj = Si^Q. 

(iii) If n is even (i.e. no = ni), then we obtain Yldes/c t^^'^^x'^ = detC, where 
C = (Cjj)o<j<no-i,o<j<ni-i is the no x rii matrix whose (z, j)th entry is 

= E E e^rr'\y^'^'^'-'\ y^.^) etf^\y^-^^^-'\ Y^.,^,). (7.7) 

(iv) If n is odd (i.e. no = ni + 1), then we obtain ^^g^c t^'^'^^'x'^ = det ( c | C ) , 
where 

=Y}L^ttHy^'^'^'-'\yrn,^^)ettHy^'^^^^^^^ (7-8) 
fc>0 u=Q 

and c = (cj)o<i<no-i is the column vector whose zth entry is 

r. p'^'^o+i)/ Amo+i~l) Y ^ 

k>0 

Proof of Theorem 17. 6L Let d G ^nm- By the bijection $ : i-^ (co,Ci) in Theo- 
remOand the fact that t^Wa;'^ = t^(co)3.co.^F(ci)^ci ^ obtain that ^2^^^ t^^'^^x'^ = 

n ^c^H t^^^^^x"^^ • t^^^^^x^'^ . Write A^n = + and Ni = ni+ mi for short. 
Let A(°) = sh(co)' and A^^^ = sh(ci)'. Note that sh(ci) \ sh (co) is a horizontal strip 
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if, and only if, A'-^-* \ A*-'^-' is a vertical strip. From Lemma 17.51 above, we conclude 
that y'jp^aR t^'^'^^x'^ is equal to 



where the sum runs over all pair (A'-^'', A*-^^) of partitions such that A^^-* C A^^-* and 
is a vertical strip. Rearrange the row and column indices, then this equals 

^ det fe(-+^) /t/(-+^-^),W.))„<det (e^'-'l F.,-,.) 

If no = ni, put 1% = Al°j_^. + j and = A^^L^- + J for < j < no - 1. Note that 
< /f^ < •■ ■ < for A; = 0,1. It is easy to see that A*^^^ \ A^^-* is a vertical strip if, 
and only if, Ij^^ — 1 < if^ < if^- Thus, if we put 

p.. _ J"^i+i)(„,{mi+i-l) Y \ 

and 

f) . . - p^'^O+i) ( (mo+i'l) Y \ , pi^'O+i) ( (mo+i-1) Y A 

_ (mo+i+l)/ (mo+j-l) Y 1\ 
— ^j-i \y ) -'mo+D ^) 

then, by Lemma IT^ ii). we obtain Xlde^R t^^'^^x'^ = det {Qij)\Pij)^ which leads to 
the desired identity ()7.7j) . If no = ni + 1, then use 

det (A) = det 





~ 








and repeat the same arguments to obtain ()7.8p . The other identities ()7.5p ()7.6p can 
be derived similarly using Lemma [7.41^ 1). □ 

If we specialize the variables in Theorem 17. 6| then we obtain the following corollary: 

Corollary 7.7. Let m and n > 1 be nonnegative integers, and fix a positive integer 
k>l. Put no = [f], mo = \n+in±l^ _ = [f J and mi = [^^±f±ij - n^. 

(i) If n is even (i.e. no = ni), then we obtain J2d£Si^ t^k{d) ^ deti?'(t), where 
R'(t) = (_R-j)o<i<„o-i,o<j<rii-i is the no x ni matrix whose (i, j)th entry is 



^ V mo + 2z-j 

f /'Tio + mi + z + J - 1\ /mo + mi + z + j - 1\ 1 

U mo + 2z-j-l J V mo + 2z-j + l Jj ^'^ 

if mo + i > and mi +j > 0, = + if mo = and mi +j > 0, 

R'iQ = 5o,i if and mo + i > and mi = 0. 
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(ii) If n is odd (i.e. no = rii + l), then we obtain J^Htzm t^^^'^'^ = det ( r I R'{t) ) , 
where R'{t) = {R[.) 

o<i<no-i,o<j<ni-i is the no x rii matrix whose (z, j)th entry 

is 

^tjiq + mi + i + j — r 
mo + 22 — j — 1 



+ 



mo + mi + i + j — 1 
mo + 2? — j — 2 



mo + mi + 2 + j — 1 
mo + 2? - i 



t (7.10) 



if mo + z > and mi + j > 0, i?^ q = C"i+i) + {"'-VY if "^o + ^ > and mi = 0, 
and -Rqj = (5oj if mo = and mi + j > 0. Here r = (5i,o)o<j<no-i is as in 
Theorem 17.61 

(iii) If n is even (i.e. no = ni), then we obtain ^^g^c t^^^'^'^ = detC"(t), where 
C'{t) = (C.(j)o<i<no-i,o<j<ni-i is the no x ni matrix whose (i, j)th entry is 



k<mo+2i—j — l 

'rriQ + mi + i + j — 2 
k-1 



mo + mi + 2 + j — 2 
k 



{1 + t' 



+ 



niQ + mi + i + j — 2 
k + 1 



(7.11) 



if mo + i > and rrii + j > 0, C'- q = 2™o+^^i(l + t) if mo + i > and mi = 
and Cqj = 6qj if mo = and mi + j > 0. 

(iv) If n is odd (i.e. no = ni+1), then we obtain ^^^^c^^ = det ( &{t) \C'{t) ) 
where C'{t) = (q^-) 

o<i<no-i,o<j<ni-i is the no x ni matrix whose (z, j)th entry 

is 

''mo + mi + 2 + j — 2^ 
k 



CL 



+ 



E 

fc<mo+2i— J — 1 

mo + mi + i + j — 2 
k-1 



niQ + mi + i + j — 2 
k + 1 



(7.12) 



if mo + i > and mi+j > 0, 2"'o+*^^(l +t) - (5j,o if nio + « > and rrii+j = 0, 
and if mo + z = and mi + j > 0. Here c'(t) = (c-)o<i<no-i is the column 

^, _ fl, if mo = z = 0, 

|2'»o+i-i (l + t), otherwise. 

For example, if n = 5 and m = 0, then no = 3, mo = 0, ni = 2, mi = 1, and 
^^g^R t^''^''^ k>l, is equal to 



vector whose ith entry is c- 



1 1 
det ( + 1 + 2t + 



3 + 6t + 8t^ + 6f + 3t\ 







t 



3 + 4t + 3f 



whereas J2d&s^^ t^kid)^ /c > 1, is equal to 



det l+t 1+t + f 





t 



= 3 + Qt + 7t^ + Qt^ + 



2 + 2t 2 + 4t + 2t2 3 + 5t + 3t2 
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Proof of Corollary 17. 7L Substitute Xj = 1 for i > 1, = t and U = 1 for i ^ k 

into Theorem l7.6l First assume no = ni. Using e"(t, 1, . . . , 1) = < /n-i\ • 

I ( r ) + (r-i)'^' if > 0, 

we obtain 

^ g { (r;) - - 0'} { ("';-^- o - 

if mi + J > 0. Use the binomial coefficient identity ^^>q (^) = ("^'^) to obtain 
(|7.9p . The case of mi + j = is treated similarly. One can prove (j7.1(J|) similarly in 
the case of uq = ni + 1. Next, to prove (ii)(a), substitute Xi = 1 for i > 1, tk = t 
and ti = 1 ioi i ^ k into ()7.7p . If mo + z > and mi + j > 0, then we obtain 



Thus, the proof of the desired identity (j7.11|) reduce to the following identity 

/mo + i - 1\ /mi + j - 1\ _ /nio + nil + i + j 

^^[k-L-aJ\u-j-p)~ ^ V k 

The other cases can be treated similarly. □ 

If we put m = in Corollary 17.71 then we obtain the following corollary: 

Corollary 7.8. Let n be a positive integer, and fix a positive integer k > 1. Put 
no=[tl. 

(i) If n is even, then we obtain Yl,d&s>^'^^^'^'^^ ^ deti?^^(t), where Rn^it) = 
{R^j)i<ij<no-i is the Uq X no matrix whose (z, j)th entry is 

if (2,j)^(0,0) and i?S,o = l. 

(ii) If n is odd, then we obtain ^^g^Rt^*^'') = det where = (i?° )o<i,j<„,o-i 
is the no x no matrix whose (z, j)th entry is 

if (z, j) ^ (0, 0), (0, 1) and R^ofi = Ki = ^■ 

(iii) If n is even, then we obtain Xldes?,? ^^'"^'^^ = det C^^{t), where C^^it) = (Qj)o<i,j<no-i 
is the no x no matrix whose (z, j)th entry is 

i + j-2\ fi+j-2 



^2i-j-2j \2i-j-lJ \ 2i-j J \2i - j + 1 
if 2 + j > 2, Q = l + t, Q 1 = t and q = 
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(iv) If n is odd, then we obtain J^deS^S ^^'^'^^ = ^"o(^)' ^^ere C°^{t) = (C° )o<i,i<no-i 
is the no x Uq matrix whose (i, j)th entry is 

c-s=|2fr{-'„Vfr^r',H(i+a (7.16) 



t 



2i-j-2j \2i-j -1 

2t-j-3j^[2t-j-2)^ [2i-j-l)^[ 2t-j 

if 2 + j > 3, Co°o = 1, Co°i = Co°2 = = 0, Ci°o = 1 + ^ and CI, = l + t + t\ 

Proof. Substitute m = in Corollary 17.71 Then we have rriQ = 1 and mi = if n 

is even, and we have ttiq = and mi = 1 if n is odd. Using this, we can directly 
compute each entry of = R'{t) (resp. R^^{t) = {f\R' (t))) in (i)(ii) of 

CoroUarv 17.71 if n is even (resp. odd). We define n x n matrices and U° by 
Un = ikj -'2Si+i,j)o<i,j<n-i and = + (2(5i2+(j_i)2,o)o<._^.<„_^ . As before we 
substitute m = in (iii)(iv) of CoroUarv 17.71 Then put C^^it) = U^^C'it) (resp. 
C°p(t) = U^^ ( r I R'{t) )) if 77, is even (resp. odd). We can compute each entry of 
Q„(t) andC°„(t) directly. □ 

For instance, in the case where n = 5 and n = 6, R^ and R^ are 

t 

3 + 4t + 3t2 

4 + 7t + 





and C° and C"^ are as follows: 



1 \ / 1 + t t 

1 + t + t , 2 + 1 + 1 + 3t + 12 



2t 3 + 3t + 3t^ \ 2t 5 + 6t + 5t 



Thus we obtain certain determinantal formulae for the generating functions of 
and weighted by Uk- Thus the above (ii) with Theorem 13.31 Theorem 16.21 and 
Theorem 17.21 proves Theorem 11.31 Here the problem of evaluations still remains: 

Conjecture 7.9. Let r be a positive integer. Let and C° as in CoroUarv 17.81 

Then the following identities would hold. 

(i) For r > 1, 

detR':{t) = All,{t). (7.17) 

(ii) For r > 1, 

det (t) = A^^^{t). (7.18) 

(iii) For r > 1, 

detC:.it) = Afl\it). (7.19) 

By Theorem 13.31 and Theorem 16.21 Conjecture 11.21 f Conjecture 6 of ^7]) reduce 
to prove the determinantal formula in ()7.17|) of Conjecture 17.91 We can prove all 
these identities in a weak form where t = 1 by reducing the determinants to the 
Andrews-Burge Theorem fLemma I7.1(J|) . Here we use the notation {A)j = A{A + 
l)...{A + j-l). 
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Lemma 7.10. (Andrews-Burge j3]) Let 



0<i,j<n-l 



Then 

n-l 



Mn{x,y) = l[A2kix + y), (7.21) 



k=0 



where Ao(m) = 2 and for j > 



(u + 2? + 2),(in + 2? + 



Especially, when y = x, we obtain the identity 



m„(x) = det ((' 2/_V)) = i n^2.(2a;) (7.23) 

\ \ J J J 0<i,j<n—l 

(see PHHIIHl). 

Theorem 7.11. Let n be a positive integer, and put r = uq = ["l] . 

(i) The number of elements of is equal to ^^^+1 if 't- = 2r — 1 is odd, i.e. 
deti?°(l) = Ay4i. 

(ii) The number of elements of is equal to ^^^l^_^2) l{r+iy. '( h ) ^ ' ^2r + 1 n = 2r is 

PVPTn i P dpt R^fl] - (3'-+2)!(2r+l)!(2r)! .ys 
even, i.e. aeX/t^l^iJ — (4r+2)!(r+l)!{r!)2 "^2r+l- 

(iii) The number of elements of is equal to ^4^"""^, i.e. detC°(l) = A^^_^^ and 
detC;(l) = AgTS. 

Proof. If we put t = 1 into R°{t) and R%t), then we obtain 

'^^ ^ n<,- ,<r_i \ \ 97 — T -I- 1 / / 9^'-l 11 



and 

'^^ ^ n<i i<r.-i \ \ 9,- _ 1 -L 9 / / 9^-1 11 



o<..<r-i V V2^ -J + 2JJ 2-1 11 (A:), {k + I) 



from ()7.23|) . A direct computation shows that these products are equal to A^^^i and 

%r+2) \{r+iy. ) ^ ' ^2r + 1 respectively. Similarly, if we put t = 1 into C°(t) and C°(t), 
then we obtain 
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and 

r-l 



fc=l 

from ()7.2ip . A direct computation shows that these products are equal to A^^^^ and 
Af^^ respectively. □ 

Thus Theorem I7.1ir i) proves Conjecture 6 of ^Tj is true (i.e. Conjecture II. 2|) when 
t = 1. 
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